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A multi-objective optimized hybrid image watermarking technique is being 
proposed considering robustness, imperceptibility and security aspects using 
two different scaling factors. In this technique, original image is subjected to 
third level lifting wavelet transform (LWT) followed by singular value 
decomposition (SVD). Watermark is split into two parts to embed each of 
them into a different subband. In the suggested scheme, firefly algorithm is 
employed to get optimum solutions for two scaling factors to balance trade- 
off amid invisibility and robustness. Security in digitized data is an 
important aspect of image processing. It is improved with a key, an input to 
Arnold transform for scrambling watermark, to watermark embedding and 
extraction procedures. All the performance parameters like peak signal to 
noise ratio (PSNR), structural similarity index measure (SSIM), normalized 
correlation coefficient (NCC) and bit error rate (BER) are used in 
formulating maximization objective function. Evaluation of the proposed 
algorithm indicates that it is characterized by fairly good robustness, 


invisibility and security. 
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1. INTRODUCTION 

The usage of cyberspace and networking technologies for content flow and exchange is rapidly 
growing. COVID-19, a global pandemic, has greatly increased data transmission. It is essential to avoid 
modifying these resources without the proper rights or authority. Copyright issues are dealt with using a 
variety of information security measures. Watermarking digital images [1] is the most effective approach for 
data authentication and copyright protection [2]. This is accomplished by embedding a text, picture or logo 
within the original image. 

Robustness, imperceptibility and security are important aspects of watermarking techniques. 
Robustness is the ability of technique to resist attacks on watermarked image whereas imperceptibility 
indicates the perceptual quality of watermarked image. Embedding approach determines whether the 
methodology is in spatial or in transform domain. Spatial domain techniques have minimal complexity, easy 
implementation but are less robust. Transform domain techniques are comparatively more complex as 
coefficients in transform domain are modified leading to high robustness. The requirement of information 
during watermark extraction decides whether the process is blind, semi-blind or non-blind. Different 
transforms like discrete cosine transform (DCT) [3], discrete wavelet transform (DWT) [4], [5], lifting 
wavelet transform (LWT) [6], stationary wavelet transform (SWT) [7], [8], contourlet transform [9] are used 
for watermarking solutions. Pros and cons of LWT and DWT based watermarking schemes are discussed 
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[10]. These transforms are clubbed with matrix decompositions like singular value decomposition (SVD) 
[11], [12], QR factorization [13]-[15] to achieve enhanced performances. Madhu and Holi [7] discussed a 
scheme based on SWT, SVD with particle swarm optimization to select optimal coefficients. DWT, DCT and 
SVD based approach pursued in [11] is more robust to attacks as JPEG compression, Gaussian blur, salt & 
pepper noise, rotation and cropping with high values of peak signal to noise ratio (PSNR). Similar scheme 
[16] highlights high robustness against Gaussian attacks. A scheme [12] based on integer wavelet transform, 
SVD and arnold transform (AT) is used to embed watermarks in a block with lowest variance. The 
orthogonal U matrix is modified making technique robust against image processing and noising attacks. 
Touati and Lakhdar [17] presented an efficient scheme based on quantization coefficient and SVD in spatial 
domain for self-embedding watermarks for compression types of attacks. A watermarking technique using 
signum of cosine matrix requires less computational time compared to SVD methods, but robustness is good 
for few attacks [18]. 

Strength of the watermark embedding depends on scaling factor. Techniques exhibit a trade-off 
between imperceptibility and robustness with varying scaling factors. A trend is observed in majority of the 
schemes, that increase in embedding strength helps to improve robustness but has a negative effect on visual 
transparency. A proper balance is to be achieved by an optimal scaling factor. Nature-inspired algorithms are 
metaheuristic optimizing methods that imitate the works of nature to solve optimization issues, leading to a 
new era in computing [19]. Many swarm-based algorithms like firefly algorithm (FA), particle swarm 
optimization (PSO), artificial bee colony optimization (ABCO), ant colony optimization (ACO) are 
effectively used for watermarking solutions [20]-[27]. 

FA is a well-known, effective, competent metaheuristic algorithm used by the researchers to solve 
the problems in fields of research such as classifications, clustering, neural networks, biomedical 
engineering, healthcare and other research domains [28]. DWT-SVD based firefly optimized scheme using 
multiple scaling factor (MSF) [21] offered good imperceptibility and robustness against selected image 
processing attacks. A scheme based on LWT, FA and regression tree using MSFs [22] contributed good 
robustness and imperceptibility. A firefly optimized algorithm with DWT and QR decomposition proposed by 
Guo et al. [23] generated comparatively good robustness against some image processing and noising attacks. 

Energy compaction and multi-resolution property of LWT helps in designing robust watermarking 
system [29], [30]. SVD is preferred as slight alteration in singular values do not affect image properties. In 
this paper, combination of LWT and SVD with FA has been explored for multi-objective optimization using 
two different scaling factors. A distinct technique is being proposed by splitting scrambled watermark in two 
different parts and each part is embedded starting from random columns to increase security. A security key ‘k’ 
is used as a scrambling parameter to AT and decides column number from where watermark insertion starts. 

The following are the paper's main contributions: i) scrambled watermark is divided into two parts 
and as the size of split watermark is less than subband size, it can be inserted from random column in a 
subband; ii) secret key ‘k’ is utilized to scramble watermark as well as it decides the column from where 
watermark insertion starts in chosen subbands; iii) two different scaling factors are optimized using FA and 
iv) result validation using a multi-objective function based on PSNR, structural similarity index measure 
(SSIM), bit error rate (BER) and normalized correlation coefficient (NCC). 

This section has included papers employing relevant schemes. Proposed method explaining 
watermark embedding, extraction and optimization algorithms is described in section 2. Section 3 deals with 
experimentation results with comparative performance to analyze suggested technique. The conclusions are 
drawn out in section 4. 


2. PROPOSED METHOD 

Three level LWT decomposition [31] of the original image gives 32x32 size subbands. LWT helps 
to remove loss in reconstruction, increases intactness of embedded watermark in the cover image and helps to 
recover watermark [6], [22]. CH3, CV3 and CD3 are high frequency subbands whereas CA3 is low 
frequency subband. Choosing the right subband for watermarking is very important. Major image properties 
are in low frequency subband and watermarking in this subband gives us image with distortions leading to 
poor imperceptibility. Similarly, diagonal subband is not preferred as it gets eliminated in image operations 
such as lossy compression. Horizontal and vertical subbands are being used in this scheme with independent 
scaling factors. Embedding of watermark in singular values of SVD has become increasingly popular as it 
can resist attacks. Watermarking in LWT-SVD provides good results but an eye is to be kept on security 
aspect. Different scaling factors are preferred over single scaling factor to achieve better security, invisibility 
and robustness. A semi-blind scheme combining LWT, SVD and FA is designed to give optimized 
robustness, imperceptibility and security against false positive detection. 
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Watermark is scrambled using Arnold transform [32] with secret key ‘k’ an input to embedding and 
extraction algorithm. Encrypted watermark is divided into two parts of 32x16. SVD is applied to CH3 and 
CV3 subbands to get orthogonal vectors and diagonal S matrix with size 32x32. Sixteen columns starting 
from the ‘k™ column are chosen for watermarking to take care of security aspect. 


2.1. Watermark insertion 

Original image is 256x256, watermark is 32x32 and security key ‘k’. Procedure for watermarking is 
as follows: 1) original Image X is transformed to three level LWT; ii) AT is applied to scramble watermark 
with key ‘k’ and scrambled watermark W is divided into two parts; 111) CH3 and CV3 subbands are chosen 
for watermarking; iv) SVD is applied to these subbands to get three matrices U;, V; and S;; v) singular values 
Sj are altered with scaling factor ô; and watermark bits starting from k" column to get 5,;; vi) SVD is applied 
to S,; and it gives watermarked singular values S,,; and Uwi Vwi; vii) new watermarked subbands CH3,, and 
CV3,y obtained by applying inverse SVD with Swi , U; and V; and viii) inverse LWT is applied to get 
watermarked image Xw . 


2.2. Firefly algorithm 

Firefly algorithm was proposed by Yang [33] inspired by flashing behaviour of fireflies. Fireflies 
communicate with each other using flashlights to attract prey and mates. Following assumptions are made for 
firefly optimization: 
a) All fireflies are unisexual so each of them can attract other regardless of its sex. 
b) Attractiveness is proportional to brightness. So less bright firefly will move towards brighter one. 

Brightest firefly flies randomly. 

c) Objective function depicts the brightness of the firefly. 

There are two key factors in FA: variation of light intensity and formulating the rate of attraction 
[22] where attraction rate B is obtained using an analogy with light intensity I. For a maximization problem, 
brightness is proportional to objective function and vice versa for minimization problem. 

Light intensity Iq is obtained by using inverse square law and absorption coefficient y as (1). 


I(d) = he” (1) 


Attraction rate B is defined as (2). 


B= pers (2) 


The distance d;; among two fireflies x; and x; at i, j is given by cartesian distance as (3). 


dij = |x; — xl = JM (Xie — Xj)? (3) 


Less bright firefly x; moves towards a brighter one x; using (4): 
-yd?, 1 
xi = Xit Boe Ü (x; — xi) + a(rand — D (4) 


where, Io is original light intensity, Bo is attractiveness at dj; = 0, Second term in (4) is due to attraction and 
the last term ensures randomness to avoid premature fall into local optimal solution. a is a randomization 
parameter and term in bracket is random value vector drawn from Gaussian distribution [22]. 


2.3. Watermark extraction 
Watermark is retrieved using key ‘k’, Uwi Vwi and Swi: 
a) Three level LWT decomposition to watermarked image gives CA3wm,CD3wm, CH3wm and 
CV3 ym subbands. 
b) SVD is applied to chosen subbands to get singular values 5S,,..; required for watermark extraction. 
c) Inverse SVD is applied to Uwi, Symi and Vwi to get Se; matrix. 
d) Watermark bits are obtained from Sei, Swi and 6; and key ‘k’ as clue. 


Wri = (Sei — Swi)/ ôi (5) 


e) Retrieved bits from two subbands are combined to reconstruct scrambled watermark. 
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f) Inverse AT is employed for ‘k’ times to get watermark and performance parameters are computed. 


2.4. Parameters for image quality assessment 

Assessment of images is very vital to watermarking application as imperceptibility and robustness 
cannot be decided visually [30], [34], [35]. Metric assessment done mathematically helps to establish and 
correlate results. Parameters for measuring the performance are defined by: 


255? 
PSNR = 10 logio sr) (6) 


Ia DaX -Xw ij)? 


MSE UN (7) 
where X is host, X,, is watermarked image and M * N is size. 
SSIM index is defined as (8): 

SSIM (x,y) = (2pxby+ky ) (2oxy+ k2) (8) 


(M+S +k1)((oZt+oF+k2) 
where kı and k are two variables used to stabilize division for small denominators, ux and uy are averages, 
Ox, Oy are standard deviations, Oxy are covariance of x and y images. 


NCC and BER are computed as (9) and (10): 


€ 
ZiŁjWijWij 


= 1 = 
NCC = Corr (w,w' ) = oe (9) 
where w is watermark, w’ is extracted watermark, 
BER = medi’ bits = B (10) 
Size of watermark h* w 


where h is height and w is width. 


2.5. Role of FA in watermark extraction 

The performance of the proposed FA is evaluated through maximization multi-objective function to 
trade-off invisibility and robustness. It is defined using all performance parameters PSNR, SSIM, NCC, 
BER. BER and NCC are calculated for 29 different attacks. 


PSNR p 


p 
Maximize(f) = Č + SSIM + 4 Eker NCC 


X? BER p 


(11) 


Where p is number of attacks, w is the balancing factor. 

The different steps for optimization are as follows: i) FA parameters n, a, Bo, y, maximum 
generations are declared; ii) all the ‘n’ fireflies are initialized randomly in 2-dimensional workspace in the 
decided range; iii) watermarked image for every firefly is generated by using watermark insertion procedure; 
iv) PSNR, SSIM are computed between original and watermarked images; v) all the attacks are applied on 
watermarked image and watermarks are extracted; vi) BER and NCC amid original and extracted watermark 
are calculated; vii) objective function as given in (11) is evaluated for each firefly; viii) best solution with 
firefly values is remembered for every iteration; ix) each firefly is updated by computing their new values as 
per (4); x) fireflies are ranked based on their fitness values (objective function); xi) Steps iii to x are repeated 
for all the generations and xii) best firefly value in all generations is returned as the best solution i.e. scaling 
factors in 2-dimensional space. 


3. RESULTS AND DISCUSSION 

The proposed scheme is evaluated on images downloaded from USC-SIPI database [36]. Gray scale 
images Lena, Cameraman, Living Room, Mandrill, Peppers and Pirate of size 256x256 are host images and 
binary watermark is of size 32x32. These standard benchmark images and watermark are shown in Figure 1. 
Experimental analysis is carried out with parameters initialized as Bo=1, a=0.1, and y=1, 12 fireflies and 
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maximum iterations as 30. Experimentations are performed in Windows 10 based MATLAB (R2020b) 
environment. Watermarked images with extracted watermarks are shown in Figure 2. 

The effectiveness of the proposed scheme is evaluated through parameters PSNR, SSIM, NCC and 
BER as shown in Table 1. Imperceptibility is perceptual similarity among original and watermarked image 
indicated by PSNR and SSIM. Watermark is inserted into all chosen images and the optimal scaling factors 
are computed using FA. Figures 1 and 2 clearly show that it is very difficult to distinguish between them 
visually. Consistently PSNR values are nearer to 50 and SSIM values are greater than 0.99. Similarly, NCC 
indicates the similarity and BER shows error bits between original and extracted watermark. NCC is almost 
near to 0.99 and BER is less than 0.006 for all images indicating fairly good results. 

Robustness of the proposed technique against 29 different attacks is depicted in Table 2 for Lena, 
Pirate and Cameraman images. The suggested system has a bit error rate of around 4% for one or two 
cropping attacks, but less than 1% for the majority of attacks. The average BER for all attacks is 0.0145, 
which means the proposed system gives a BER of 1.45%. Attacked images with extracted watermarks for 
few attacks is shown in Figure 3. 


SA 


Peppers Pirate Watermark 


Figure 1. Orginal images and watermark 


Mandrill Peppers Pirate 


Figure 2. Watermarked images and extracted watermarks for standard images given in Figure 1 


Table 1. Results for six benchmark images 


Images Proposed method 
PSNR SSIM NCC BER 
Lena 50.6858 0.9943 0.9831 0.0059 


Cameraman 50.9697 0.9746 0.9858 0.0049 
Living Room 50.7804 0.9969 0.9915 0.0029 


Peppers 50.4411 0.9918 0.9972 0.0009 
Mandrill 50.7410 0.9989 0.9887 0.0039 
Pirate 50.6860 0.9944 0.9915 _ 0.0029 


3.1. Security analysis 

Watermarking schemes based on SVD specifically suffer from the problem of false positive 
detection when watermark is embedded in singular values [37]. This problem is tackled in the current scheme 
by inserting a security feature using a key which acts as an input to AT, embedding and extraction 
procedures. Let ‘k’ be the key to scrambler and insertion procedure, nl and n2 be the keys to inverse 
scrambler and to extraction procedure respectively. During watermark insertion, this key is 5. Three different 
tests conducted are shown: 
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a) The decoder has the correct key for inverse scrambler but incorrect key for extraction procedure. Figure 4 
shows results for three incorrect inputs. 

b) The decoder has the correct key for extraction procedure but incorrect key to inverse scrambler. Figure 5 
shows outputs for different inputs to AT. 

c) The decoder has the incorrect key for extraction procedure and inverse scrambler. Figure 6 shows 
results for the same. 


Cropping top left 


Speckle noise 0.001 Gaussian noise 0.001 


Salt & pepper 0.01 Poisson noise 


SA SA 
Cropping centre Cropping right bottom Scaling 256-512-256 Rotation 90° Rotation 180° 


SA 


Low pass filter 3x3 Median filter 3x3 JPEG compression 80 


Histogram equalization 


Pri p AEE TALPES EE E Ti 
A Rhee + i ca i 
a one 
nec ? prian, : 
=e) vre- 
DEERD BYA +, 
nl=5, n2=12 nl=2, n2=5 nl=4, n2=5 nl=15, se 5 


Figure 4. Security test for false keys during extraction Figure 5. Security test for false keys during inverse 
AT 
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f. 


nl=n2=7 


nl=n2=12 


Figure 6. Security test for false key both to inverse AT and extraction procedure 


Table 2. Robustness of the proposed technique against various attacks in terms of NCC and BER 
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Attacks Parameter NCC BER NCC BER NCC BER 
Lena Pirate Cameraman 

Salt & pepper 0.01 0.9689 0.0107 0.9659 0.0117 0.9659 0.0117 
0.02 0.9603 0.0137 0.9520 0.0166 0.9745 0.0088 
0.03 0.9461 0.0186 0.9687 0.0107 0.9319 0.0234 
Poisson attack 0.9604 0.0137 0.9607 0.0137 0.9659 0.0117 
Speckle noise 0.001 0.9718 0.0098 0.9858 0.0049 0.9858 0.0049 
0.005 0.9801 0.0068 0.9744 0.0088 0.9716 0.0098 
0.009 0.9744 0.0088 0.9773 0.0078 0.9773 0.0078 
Gaussian noise 0.001 0.9744 0.0088 0.9689 0.0107 0.9801 0.0068 
0.005 0.9830 0.0059 0.9633 0.0127 0.9716 0.0098 
0.009 0.9630 0.0127 0.9660 0.0117 0.9488 0.0176 
Cropping top left 0.9262 0.0273 0.9098 0.0332 0.9020 0.0352 
centre 0.8837 0.0420 0.9165 0.0313 0.8733 0.0479 
right bottom 0.9213 0.0293 0.9068 0.0342 0.8763 0.0439 
Scaling 256—512—256 0.9943 0.0020 0.9943 0.0020 0.9915 0.0029 
128—2561—28 0.9561 0.0156 0.9440 0.0205 0.9558 0.0156 
Rotation 90° 0.9112 0.0313 0.9385 0.0215 0.9264 0.0254 
180° 0.9887 0.0039 0.9858 0.0049 0.9915 0.0029 
Gamma correction 0.9 0.9752 0.0088 0.9802 0.0068 0.9887 0.0039 
0.6 0.9311 0.0254 0.9773 0.0078 0.9691 0.0107 
JPEG 80 0.9943 0.0020 0.9972 0.0010 0.9915 0.0029 
75 0.9887 0.0039 0.9943 0.0020 0.9887 0.0039 
50 0.9801 0.0068 0.9858 0.0049 0.9830 0.0059 
Gaussian filter 3x3 0.9801 0.0068 0.9858 0.0049 0.9830 0.0059 
5x5 0.9801 0.0068 0.9858 0.0049 0.9830 0.0059 
Low pass filter 3x3 0.9221 0.0283 0.9183 0.0303 0.9291 0.0254 
Median filter 3x3 0.9512 0.0176 0.9356 0.0234 0.9376 0.0225 
Histogram equalization 0.9745 0.0088 0.9745 0.0088 0.9515 0.0166 
Sharpening 0.9744 0.0088 0.9773 0.0078 0.9773 0.0078 
Wiener filter 0.9411 0.0215 0.9366 0.0234 0.9461 0.0195 


3.2. Comparative analysis 

Feature comparison of the proposed technique with a technique in [25] is shown in Table 3. The 
current scheme is a semi blind watermarking scheme in LWT+SVD domain, embedding with modification of 
singular values and optimization is implemented using firefly algorithm. Technique discussed in [25] is also a 
semi blind watermarking scheme in LWT+SVD domain, embedding with modification of singular values and 
optimization is implemented using artificial bee colony. Imperceptibility and robustness comparison of the 
proposed technique for image Lena with [25] is represented in Table 4. PSNR values for both the schemes 
are almost same whereas NCC is slightly higher for [25]. The suggested technique is more robust against 
most attacks barring few like salt & pepper, cropping and scaling but the parameters for these attacks are not 


clearly indicated in the reference being used. 


Table 3. Feature comparison of proposed 
scheme with [25] 


Table 4. Imperceptibility and robustness comparison 
of proposed technique with [25] for image Lena 


Features Proposed [25] Parameters Proposed [25] 
Scheme type Semi-blind Semi-blind Imperceptibility 
Domain used LWT+SVD LWT+SVD PSNR 50.6858 50.3469 
Optimization Firefly algorithm Artificial bee Robustness (NCC) 
colony Without attacks 0.9831 1 

Original image 256x256 512x512 Salt & pepper 0.9689 0.9832 
size Poisson 0.9604 0.8757 
Watermark size 32x32 64x64 Speckle noise 0.9718 0.9346 
Multi-objective Yes yes Cropping 0.9262 0.9804 
Fitness function Function of PSNR, Only NCC Scaling 0.9943 1 

BER, NCC and SSIM Histogram equalization 0.9745 0.9314 
Security analysis Yes No Sharpening 0.9744 0.9194 
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4. CONCLUSION 

The perfect reconstruction and energy compression property of LWT prevents loss in information, 
aids in the resistance to variety of attacks. Changes in singular values do not alter structural information but 
only affect luminance of the image thereby making system more robust and imperceptible. The security of 
the SVD based schemes is enhanced by inserting watermark from random columns. Subbands do contain 
different information and scaling factor for each of them can be different. Two different optimum scaling 
factors are computed to decide the watermark embedding strength for maximum performance in each 
subband. Computation of multiple scaling factors puts a toll on computing speed and this is avoided here by 
using only two scaling factors. Objective function features all metrics thus helping to improve PSNR, BER, 
SSIM and NCC in a balanced manner. The main feature of the proposed technique is to apply FA to find 
optimum scaling factors for balancing the trade-off giving PSNR, NCC and SSIM greater than 50 dB, 0.96, 
0.9940 respectively and average BER less than 1.45%. Comparative analysis indicates that the proposed 
technique gives almost same imperceptibility but robustness has improved to a great extent. Security analysis 
is also an added feature in the current scheme while doing comparative analysis. It can be said current 
scheme is highly robust, imperceptible and secure against non-authorized access of the content and it can be 
practically used for any applications wherein copyright violations are to be avoided. 
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